Data-driven engineering design research: Opportunities using open data

Engineering Design research relies on quantitative and qualitative data to describe design-related phenomena and prescribe improvements for design practice. Given data availability, privacy requirements and other constraints, most empirical data used in Engineering Design research can bedescribed as “closed”. Keeping such data closed is in many cases necessary and justifiable. However, this closedness also hinders replicability, and thus, may limit our possibilities to test the validity and reliability of research results in the field. This paper discusses implications and applications of using the already available and continuously growing body of open data sources to create opportunities for research in Engineering Design. Insights are illustrated by an examination of two examples: a study of open source software repositories and an analysis of open business registries in the cleantech industry. We conclude with a discussion about the limitations, challenges and risks of using open data in Engineering Design research and practice

A Networked Perspective on the Engineering Design Process: At the Intersection of Process and Organisation Architectures

The design process of engineering systems frequently involves hundreds of activities and people over long periods of time and is implemented through complex networks of information exchanges. Such socio-technical complexity makes design processes hard to manage, and as a result, engineering design projects often fail to be on time, on budget, and meeting specifications. Despite the wealth of process models available, previous approaches have been insufficient to provide a networked perspective that allows the challenging combination of organisational and process complexity to unfold. The lack of a networked perspective also has limited the study of the relationships between process complexity and process performance. This thesis argues that to understand and improve design processes, we must look beyond the planned process and unfold the network structure and composition that actually implement the process. This combination of process structure—how people and activities are connected—and composition—the functional diversity of the groups participating in the process—is referred to as the actual design process architecture. This thesis reports on research undertaken to develop, apply and test a framework that characterises the actual design process architecture of engineering systems as a networked process. Research described in this thesis involved literature reviews in Engineering Design, Engineering Systems, Complexity and applied Network Science, and two case studies at engineering design companies with the objective of iteratively developing the framework and providing a proof-of- concept of its use in a large engineering design project. The developed Networked Process (NPr) Framework is composed of a conceptual model of the actual design process architecture, and an analytical method that allows the model and data- driven support to be quantified. The framework provides a networked perspective on three fundamental levels of analysis: 1) the activity-level, characterised as a network of people performing each activity, 2) the interface-level, characterised as a network of people interfacing between two interdependent activities, and 3) the whole process-level, characterised as a dynamic network of people and activities. The aim of the framework is to improve the design process of engineering systems through a more detailed overview of the actual design process, to support data-driven reflection of the relationship between process architecture and performance, and to provide the means to compare process plans against the actual process. The framework is based on a multi-domain network approach to process architecture and draws on previous research using matrix-based and graph-based process models. The results of the NPr Framework’s application in two case studies showed that decision makers in engineering design projects were able to gain new insights into their complex design processes through the framework. Such insights allowed them to better support and manage design activities, process interfaces and the whole design process. The framework also was used to enrich project debriefing and lessons-learned sessions, to spot process anomalies, to improve design process planning, to examine process progress, and to identify relationships between process architecture and performance. Contributions to knowledge include: First, the development of a more complete model of the actual process architecture and concrete analytical methods to quantify the developed model. Second, the identification of key structural and compositional variables as well as tests to identify the relationship between those variables and performance metrics. Third, the creation of a platform for further research on the relationships between actual design process architecture, behaviour and performance

Characterizing Design Process Interfaces as Organization Networks: Insights for Engineering Systems Management

The engineering design literature has provided guidance on how to identify and analyze design activities and their information dependencies. However, a systematic characterization of process interfaces between engineering design activities is missing, and the impact of structural and compositional aspects of interfaces on process performance is unclear. To fill these gaps, we propose a new approach that characterizes process interfaces as organization networks consisting of people and their interactions when performing interfacing activities. Furthermore, we provide guidance on how to test and interpret the effect of those characteristics on interface problems. As a result, we show how structural and compositional aspects of the organization networks between information-dependent activities provide valuable insights to better manage complex engineering design processes. The proposed approach is applied to the development of a power plant, analyzing 79 process interfaces. The study reveals a relationship between the structure and composition of the process interfaces and reported interface problems. Implications of this approach include the integration of information about process and organization architectures, the systematic identification of key performance metrics associated with interface problems, and improved support for engineering managers by means of a better overview of information flows between activities

Dynamism in complex engineering : explaining uncertainty growth through uncertainty masking

The development of uncertainty over the progression of a project (i.e. dynamism) is a central issue in engineering management; however, it has been little explored. This paper answers the question of how uncertainty develops over the course of complex engineering. We present a case of a renewable energy power plant where we performed content analysis on over 54,000 e-mails. The findings reveal a new mechanism affecting uncertainty development. We call this mechanism 'uncertainty masking' and define it as: the process through which a 'root uncertainty' is misidentified by the project team, resulting in the creation and management of a 'symptomatic uncertainty'. Root and symptomatic uncertainty types compound over time and hamper uncertainty resolution, leading to growth in level of uncertainty during later project stages. We describe the impact of uncertainty masking on the u-shape level of uncertainty in the case project. This research contributes to the engineering-management literature by explaining observations of uncertainty growth, which existing theory is unable to explain. We thus significantly advance uncertainty theory in engineering management

Tracing paths and connecting multiple design domains: An information visualisation approach to product architecture modelling

Visual representation of product architecture models is crucial in complex engineering systems design. However, when the number of entities in a model is large and when multiple levels of hierarchies are included, visual representations currently in use need to be more intuitive. As such, improved visual representations that enable better system overview and better communication of essential product-related information among design participants are needed. This paper uses interactive information visualisation techniques – collapsible hierarchical tree, edge bundling and alluvial diagram – and provides the foundations of a computerised tool that improves the traceability of connections between design domains, including stakeholders, requirements, functions, behaviours and structure. The case of a cleaning robot is used as an illustrative example. The approach supports designers by providing an enhanced overview during the development of complex product architecture models, in particular in the communication with external stakeholders, in the identification of change propagation paths across several design domains, and in capturing the design rationale of previous design decisions